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ABSTRACT 


Discrete  optimization  subject  to  one  contraint  is  attacked  by 
Lagrangian  analysis.  Incremental  allocation  schemes  are  given  chat 
generate  undominated  allocations.  In  an  important  special  case,  the 
complete  family  of  undominated  allocations  is  generated. 
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1.  Introduction 

In  allocation  problems,  a  marginal  analysis  of  incremental  return 
per  additional  dollar  spent  is  intuitively  appealing.  We  give  condi¬ 
tions  under  which  it  is  justified  and  applications.  In  some  circles, 
some  of  our  results  are  probably  part  of  the  folklore. 

2.  Problem 

(*)  max  ($(x)  :  x^S,  C(x)  «;  M} 

where  S  is  the  set  of  n- tuples  of  nonnegative  integers  (x, ,  ...,  x  ), 

1  n 

n 

C(x)  *  £  c  x 

j-1  J  J 

H,  c^  >  0,  j  —  1,  . ..,  n, 

and 

n 

0(x)  «  2  0.(x  )  . 
j-1  J  J 

3.  Procedure 

1.  Start  with  the  allocation  x°  -  0. 

2.  k  *  1. 

3.  xk  *  xk  x  +  ei,  where  ei  is  the  ith  unit  vector  and  i  is 


any  index  for  which 


OjCXj'1  +  1)  -  0j(*j'l)]/'j 

is  maximum. 

4.  If  C(x  )  >  M,  terminate;  otherwise  k-.k+l  and  go  to  step  3. 

4.  Variant  1 

A  slight  variant  of  the  foregoing  procedure  is  to  terminate  when 
the  objective  function  first  exceeds  a  preassigned  value  instead  of 
when  the  cost  exceeds  a  preassigned  value. 

5.  Variant  2 

A  second  variant  is  to  branch  at  step  3  whenever  ties  occur  for 

the  maximizing  index.  Let  I  be  the  set  of  maximizers.  The  procedure 

k- 1  k 

is  successively  initiated  with  the  allocations  x  +  e^  i€I  . 

6.  Lagrangian  Analysis 
Allocations  x  satisfying 

0( y)  >  0(x)  =*  C(y)  >  C(x) 

0(y)  =  0(x)  >  C(y)  ;>  C(x) 


for  all  y  are  called  undominated. 
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Lemma  1,  If  X  2  0  and  x  £$  maximises  the  Lagrangian  0(x)  -  Xg(x)  over 

all  x€&,  then  x  maximizes  0(x)  over  all  those  x€$  such  that  g(x)  $ 

* 

g(x  ). 

Proof.  This  is  a  special  case  of  a  result  of  Everett  [3].|j 

As  X  varies  over  (0,a>)  not  all  undominated  allocations  are  necessarily 

generated.  For  a  geometrical  explanation  of  this  fact,  see  Everett  [3]. 

Let  m^CX)  be  the  smallest  nonnegative  integer  m  (assumed  to  exist) 
satisfying  ^(m  +  1)  -  0i(m)  <  Xc^,  E^Cx)  be  the  set  of  nonnegative 
integers  m  for  which  0i(m  +  1)  -  0^)  *  X^,  T.(x)  *  {m^ ( X) }  UE^X), 

and  T(X)  =  T^(X) -  In  what  follows,  a  function  defined  only  on 

the  integers  is  called  concave  if  its  first  differences  are  decreasing. 

Theorem  1,  For  any  X  >  0,  if  0i(y)  is  concave,  i  *  1,  ...,  n, 
x(X)€T(X)  =»  x(X)  is  undominated. 

Proof.  Apply  Lemma  l.|| 

If  0i(y)  is  strictly  concave,  m^X)  exists  for  all  X  >  0.  If  0^(y)  is 
differentiable,  T^(x)  can  be  found  by  evaluating  0^(y)  ~  Xyc^  at  the 
nonnegative  integers  neighboring  the  roots  0^(y)  -  Xc^.;  of  course, 
if  0i(y)  is  strictly  concave,  there  is  a  unique  root. 

Tneorem  2.  If  0^(y)  is  concave  and  strictly  increasing,  i  *  1,  ...,  n, 
the  allocations  generated  by  the  incremental  allocation  procedure  are 
undominated. 

Proof.  Set  x  equal  to  the  value  of  the  maximum  in  step  3  of  the  proce- 

k  k 

dure.  From  the  definition  of  x  ,  it  is  easily  checked  that  x  €T(x). 

Now  apply  Theorem  l.jj 
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From  the  proof  of  Theorem  X,  we  see  that  as  X  varies  over  (0,a»)  all  the 
allocations  generated  by  the  incremental  allocation  procedure  are  found; 
with  Variant  2,  the  converse  is  true  as  long  as  C(x(x))  £  M.  An  al¬ 
ternate  proof  of  Theorem  2  can  be  found  by  adapting  a  proof  of  a  theorem 
on  redundancy  optimization  found  in  Barlow  and  Proschan  [2],  pp.  167- 168- 
In  the  incremental  allocation  procedure,  we  may  replace  the 
starting  allocation  x°  -  0  by  any  other  undominated  allocation  obtained 
from  Lagrangian  analysis.  By  suitable  iterations  on  trial  values  of 
X,  a  better  starting  allocation  can  be  generated.  Conversely,  having 
generated  an  allocation,  we  can  immediately  find  a  corresponding  X  = 
max  [0(xi  +  1)  -  0)x^)3/C£»  which  can  be  interpreted  as  the  approximate 
shadow  price  of  the  resource  being  allocated;  it  may  be  useful  for 
sensitivity  analysis. 

Theorem  3.  If  0^(y)  is  concave  and  strictly  increasing,  i  “  1,  ...,  n, 

1  in 

x  ,  . ..,  x  are  the  allocations  generated  by  the  procedure,  and  z  is 
optimal  for  (*), 

0(xm)  >  0(z)  2t  0(xm  X) 

and 

C(xm)  >  C(z)  s  C(xm  1) 

0  <  C(xm)  -  C(xm  *)£  max  c  . 

j  J 

Proof.  Use  the  definition  of  the  procedure  and  apply  Theorem  2.|| 
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Vf& 


Let  Z  denote  the  s  t  of  optimal  allocations  £o  (*).  Although 
it  is  not  necessarily  true  that  xm  ^  £Z,  the  inequalities  in  the 
theorem  can  be  us  1  to  check  if  the  procedure  has  generated  an  allocation 
sufficiently  near  optimal  for  practical  purposes.  If  not,  the  exact 
solution  can  be  found  by  dynamic  programming,  which  requires  much  more 
computational  effort. 

In  the  important  case  of  equal  c^'s  we  can  strengthen  the  preceding 
theorem. 


Corollary  1.  If,  in  addition  to  the  conditions  stated  in  Theorem  3, 

c^  =  ...  =  cn,  then  the  procedure  generates  an  optimal  allocation; 
m-1 

i.e. ,  x  £Z. 

m  in**  1 

Proof,  C(x  )  =  C(x  )  +  c^.  There  is  no  allocation  y  such  that 
C(xm)  >  C(y)  >  C(xm  *).  From  Theorem  3,  it  follows  that  xm  *  €Z.|| 

Gross  [A]  proves  this  result  directly. 

Corollary  2.  If,  in  addition  to  the  conditions  stated  in  Theorem  3, 
s  ...  =  the  solution  to  (*),  say  o(M),  is  concave  and  strictly 
increasing  in  M,  when  M  is  restricted  to  integral  multiples  of  C^. 

Proof.  Let  u  and  v  be  optimal  allocations  corresponding  to  a(M  -  1) 
and  a(M),  respectively.  Assuming  that  incremental  allocation  was  used, 
we  have 


o(M  +  1)  -  a(M)  *  0i(vi  +  I)*"  0i(vi) 

a(M)  -  o(M  -  1)  «  0^0^  +  1)  -  0^  (ui)  , 

say.  By  definition  of  the  procedure,  0j(uj  +  1)  -  0j(uj)  ^  0^(v^  +  1) 
-  0^(v^);  hence  a(M)  -  cx(M  -  1)  s  o(M  +  1)  -  o(M),j| 


i 


sT 


s-  'MJpW 


.  ASdKSriUvvw  C« 
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The  concavity  condition  is  essential  Examples  can  be  easily 
constructed  where  the  conclusion  of  theorem  3  fails  to  hold  when  the 
concavity  condition  is  dropped.  If  0(x)  is  linear,  say  £  a^  x^,  a 
direct  proof  of  Theorem  3  is  immediate,  although  the  set  of  bounded 
allocations  maximizing  the  Lagrangian  in  this  case  is  either  empty  or 
consists  only  of  the  null  vector,  except  when  \  »  max  With  a 

linear  objective  function,  we  have  a  version  of  the  knapsack  problem, 
for  which  special  methods  are  available  to  find  the  exact  solution; 
see  Gilmore  and  Gomory  ([6],  [7])  and  the  review  paper  of  Balinski  [1]. 

7.  Nonconcave  Objective  Functions 


We  now  drop  the  restriction  that  0.  (y)  be  concave.  Call  0.( y)  the 

i  i 

least  concave  majorant  of  0i(y|H),  the  restriction  of  0i(y)  to  the  set 
N  of  nonnegative  integers,  and  let  Y^  {y0J  :  0i(y)  *  0i(y))»  It  is 
easily  seen  that  the  line  Xyci  +  max  {0i(x)  -  Xxc^  *  x€N]  never  lies 
below  0i(y]N);  this  motivates 


Lemma  2.  y.  €N  maximizes  L.(y)  =  0.(y) 


t  Xyei  over  N  =>  y£  €Yj[. 


V  X  , 

Proof.  Suppose  to  the  contrary  that  y^  is  a  maximizer  but  y^  ^  Y^. 
Let  x  [z]  be  the  largest  [smallest]  element  of  Y^  less  [greater]  than 


* 

V 


y. .  It  follows  that 


0<<z)  -  0,(yi) 


2  '  yi 


XCf 


<;  0 


4. 


and 


* 


0i(yi)  -  0i(x) 


XC4  * 


Li(yi> 


yi  -  * 


ic 

yi 


k  o 


-  X 


h 


ML 
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From  these  relations,  it  follows  that 


0i(z) 


X  , 

since  ^  Y^,  we  have 


0i(z)  -  0i(y*)  0.(y*)  -  0i(x) 

_  >  _ 


z  -  y. 


yi  -  X 


a  contradiction.  || 

On  the  other  hand,  if  y'€  Y^  -  {0},  by  setting  X  -  0i(y)/yci  we  see 

that  there  exists  a  X  such  that  y'  maximizes  0i(y)  -  X*—. 

Thus,  we  may  easily  modify  the  incremental  allocation  procedure 

to  generate  undominated  allocations  when  each  term  of  the  objective 

function  is  strictly  increasing  but  not  necessarily  concave.  It  is 

obvious  that  x°  =  0  is  undominated.  Inductively,  suppose  that  xl  *  * 

(x. ,  ...  )  is  undominated  and  x.£Y.,  i  -  1,  ...»  n.  Let  y,  be  the 

1  n  li  '  i 

smallest  element  of  Y^  that  is  larger  than  x . ,  i  =  1,  ...,  n. 

Theorem  4.  If  i  is  an  index  for  which 

0j( Yj)  -  0j<xj> 

Vyj  -  V 


K 

is  maximum,  the  allocation  x  =  (x.,  ...,  x.  „ ,  y.,  x. 

1  i-1  ■'l*  i+1* 


- . . ,  x  )  is 
n' 


undominated. 


Proof.  By  Lemma  2  we  may  replace  the  set  3  in  Lemma  1  by  Y^. 

The  re.*  t  of  the  proof  is  analogous  to  that  of  Theorem  2.  j| 
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A  technique  of  Barlow  and  Pvoschan  [2],  pp.  167-168,  can  easily  be 
extended,  as  in  Feeney  and  Sherbrooke  [A],  to  produce  an  alternate 
proof.  However,  our  proof  shows  more  clearly  the  relation  to  standard 
Lagrangian  analysis;  see  the  remarks  following  Theorem  2. 

The  suitability  of  incremental  allocation  for  practical  applica¬ 
tion  depends  on  the  spacings  of  the  allocations  generated.  Feeney 
and  Sherbrooke  [4]  describe  an  application  where  the  successive  un¬ 
dominated  allocations  generated  are  close  together. 

8.  Nonlinear  Constraint 

Let  0j(xj)  be  concave  and  strictly  increasing,  j  =  1,  ...,  n. 

If  C(x)  *  £  cj(xj)  with  cj(xj)  convex  and  strictly  increasing,  j  =  1, 
...,  n,  and  we  replace  the  criterion  of  step  3  of  the  procedure  by 

0j(xj  1  +  ^ 

/  k-1  ,  ..  ,  k-1.  * 

Cj(  j  +  -  Cj(xj  > 

all  the  allocations  generated  are  undominated.  The  proof  is  analogous 
to  that  of  Theorem  2. 

A  nonconvex  constraint  can  be  treated  by  an  analog  of  the  method 
of  the  preceding  section. 


9.  Application  1 

In  the  well-known  flyaway-kit  problem  (see  Karr  and  Geisler  [9] 
and  Geisler  and  Karr  [5]),  the  expected  stockout  cost  for  item  j 
Xj  units  of  item  j  are  included  in  the  kit  is 


W  ’  bj  (k  •  V  pj(k) 


when 
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where  >  0  and  p ^ (k)  is  the  probability  that  k  units  of  item  j 
are  demanded.  Setting  0j(xj)  =  Cand  replacing  rain  £  Yj(xj) 


by  max  £  0j(xj)]>  we  have 


0j<xj  +  1)  -  0j(xj)  =  b^  PjCx.) 


where 


P.(k)  =  £  P.(i)  . 

J  i=k  J 

Since  Pj(xj)  *-s  decreasing  in  x^,  0j(Xj)  is  coricavei  thus,  the 
marginal  analysis  application  in  [5]  and  [9]  is  justified. 


10.  Application  2 


Consider  the  problems 


n  xj 
min  £  P  J 

j=l  J 


s.t.  £  x  =  X 
j=l  2 


*  nonnegncive  integer,  j  *  1, 

k  y± 

max  n  (1  -  q.  ) 
i=l  1 


s-t.  £  y  «  Y 
i=l 


y ^  -  nonnegative  integer,  i  «  1,  ...,  k 
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Th'2  Pj*s  and  q^'s  are  constants  between  0  and  1.  It  is  easily  shown 

that  the  objective  function  in  (A)  is  the  sum  of  convex  functions; 

n 

hence,  the  procedure  can  be  (legitimately)  applied  with  -  £  p.  J  as 

j-1  J 


objective  function.  In  (B),  it  is  equivalent  to  maximize 

k  yl 

£  log(l  -  q  ),  each  term  of  which  is  easily  shown  to  be  concave. 
i*l  1 

Landi  [10]  gives  a  war  gaming  problem,  studied  earlier  but  less 
generally  by  Piccarielo  [11],  in  which  the  solutions  of  (A)  and  (B) 
are  composed  to  obtain  an  optimal  allocation  of  attacking  missiles 
to  an  opposing  missile  launch  complex.  Denoting  by  F(X)  and  G(Y) 
the  solutions  of  (A)  and  (B) ,  respectively,  let 


H(T)  -  min  [F(X)[1  -  G(Y>]  :  X,  Y  £S,  X  +  Y  =  T]  . 

In  the  missile  allocation  context,  H(T)  turns  out  to  be  the  minimum 

expected  number  of  missiles  launched  in  retaliation  after  an  attack 

by  T  missiles,  if  we  interpret 

Pj  4-»  probability  of  survival  of  launch  pad  j; 

q^*-*  probability  of  survival  of  control  center  i; 

X  the  number  of  missiles  allocated  to  attack 
launch  pads ; 

Y  ♦♦  the  number  of  missiles  allocated  to  attack 
control  centers; 

x. «-»  the  number  of  missiles  allocated  to  attack 
^  launch  pad  j ;  and 

y.  ♦-*  the  number  of  missiles  allocated  to  attack 
*  i 

control  center  j , 

with  the  understanding  that  if  at  least  one  control  center  survives 
an  enemy  attack,  all  surviving  missiles  can  be  launched,  and  if  all 
control  centers  are  destroyed,  none  of  the  surviving  missiles  can  be 


launched.  It  is  assumed  that  of  the  N  +  C  separate  targets  (N  issiles, 

C  redundant  control  centers)  at  most  one  can  be  destroyed  by  a  single 
enemy  missile. 

From  Corollary  2  it  follows  that  F(X)  and  1  -  G(Y)  are  both  convex 
and  strictly  decreasing.  Unfortunately,  this  does  not  imply  that  -  log 
F(X)  and  -  log  [1  -  G(Y)]  are  concave.  However,  since  we  have  effectively 
only  two  variables  at  this  stage,  the  combinatorial  problem  can  be  solved 
by  brute  force  without  difficulty. 
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